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The concept of continuous-time random walks (CTRW) is a generalization of ordi- 
nary random walk models, and it is a powerful tool for investigating a broad spectrum 
of phenomena in natural, engineering, social and economic sciences. Recently, sev- 
eral theoretical approaches have been developed that allowed to analyze explicitly 
dynamics of CTRW at all times, which is critically important for understanding 
mechanisms of underlying phenomena. However, theoretical analysis has been done 
mostly for systems with a simple geometry. Here we extend the original method 
based on generalized master equations to analyze all-time dynamics of CTRW mod- 
els on complex networks. Specific calculations are performed for models on lattices 
with branches and for models on coupled parallel-chain lattices. Exact expressions 
for velocities and dispersions are obtained. Generalized fluctuations theorems for 
CTRW models on complex networks are discussed. 
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I. INTRODUCTION 



Continuous-time random walks (CTRW) are stochastic lattice models that have been 
introduced by Montroll and Weiss in 1965 as a generalization of ordinary random walk 
processes.- - - In these models the motion of particles between different states is generally 
controlled by random waiting-time distribution functions. Simple random walks are recov- 
ered when the waiting-time distributions are exponential functions It turned out that 
CTRW is a powerful and efficient method for studying a wide distribution of complex dy- 
namic processes in natural sciences, engineering, social sciences and in economics.- - — It is 
natural to utilize CTRW for understanding transport phenomena that cannot be described 
within classical diffusion framework.-^ Recent experimental advances in single-molecule 
techniques that allowed to visualize various chemical and biological processes with high 
temporal and spatial resolution stimulated the application of CTRW for investigating bio- 
logical and cellular transport phenomena with anomalous diffusion.— - — 

Theoretical studies of complex dynamic phenomena that utilize CTRW models mostly 
concentrate on large-time dynamics.- 1 ^ While this might be a reasonable approach for sys- 
tems where stationary states are well established and can be quickly reached, in many cases 
to fully understand mechanisms of complex processes one needs to have a description of 
dynamic behavior at all times. In addition, the situation is more complex for system that 
never reach the steady-state limit. The original work of Montroll and Weissi suggested that 
all-time dynamics of CTRW can be obtained by utilizing Laplace-Fourier transformations. 
Although this analysis is formally correct, it is practically impossible to apply for real dy- 
namic processes. Recently, a new method of calculating dynamic properties of particles in 
the CTRW model at all times has been introduced.— It is based on analyzing a propagator 
and surviving probabilities to calculate analytically exactly Laplace transforms of all dy- 
namic properties, which effectively provides all-time description of the underlying processes. 
It was later extended to a CTRW model with branched states as a way of investigating 
biased diffusion in tubes with periodic dead ends.— However, it can be shown that this 
method could be utilized only for homogeneous CTRW with the same set of waiting time 
distributions at each site, limiting its application for more complex dynamic phenomena. An 
alternative theoretical method of calculating all-time dynamic properties in CTRW mod- 
els have been presented by one of the authors.— 1 It utilizes a generalized master-equations 
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approach^ 1 ^ 2 . that allows fast and efficient computation of all Laplace transforms of prob- 
ability functions and all dynamic properties of the CTRW models. The advantage of the 
method is the ability to analyze some inhomogeneous CTRW models as well as more com- 
plex systems, as was shown explicitly for simple periodic CTRW models and for processes 
with irreversible detachments.— 

Most of chemical and biological processes can be viewed as complex networks of states that 
are connected by dynamic transitions. The application of CTRW method for understanding 
mechanisms of these systems require a theoretical analysis that is valid at all time scales. In 
this paper, we extend the generalized master-equations method to analyze all-time dynamics 
of CTRW models on complex networks. It is interesting to note that closely related method 
has been proposed recently for temporal fully-connected networks=> In this work, stationary 
networks will be investigated. Specifically, dynamic properties for the CTRW models with 
branched states and the coupled parallel-chain CTRW models are obtained and analyzed. 
In addition, generalized fluctuations theorems for these systems are discussed. 

II. CTRW ON LATTICES WITH BRANCHES 

There are many different type of geometries in complex networks that might characterize 
various dynamic processes. In this paper, we specifically consider 2 types of geometries: a 
model with branched states and a parallel-chain lattice model as shown in Fig. 1; but the 
analysis can also be straightforwardly extended to other network topologies. 

First, we consider the CTRW model on the lattice with branched states, as illustrated 
in Fig. la. The dynamics of the random walker in this system is governed by a set of 
waiting-time distribution functions. The particle at the site % on the main lattice can jump 
one step forward with the probability ipf(t)dt, while the step backward can take place with 
the probability ip~(t)dt. The particle could also move into the branched state with the 
probability ipf(t)dt, and the motion back to the main lattice is controlled by the probability 
ipi(t)dt (see Fig. la). It is assumed that the system is homogeneous, i.e., waiting-time 
distribution function are independent of the state i: ipf(t) = tp^it); (*) = ^{P) an d 
ip](t) = ijPif). Since detachments into the branched state are reversible the probability to 
find the particle in the system is conserved. 

Our method of calculating all-time dynamic properties in CTRW models is based on the 
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important result obtained by Landman, Montroll and Shlesinger in 1977. 3 - They showed that 
the dynamics of the particle in any CTRW model can be fully described by a generalized 
master equation. For the system with branched states we define P n j{t) as the probability of 
finding the random walker at the site n at time t. Here, the label j = corresponds to the 
site on the main lattice, while j = I represents the branched state. It is assumed that at 
t = the particle starts at the origin (n = 0) on the main lattice. Then the corresponding 

generalized master equations can be written as 

t 

= j ^ + (r)P n _ li0 (t - r) + <p-(r)P n+lfi (t - r) + ^(r)P nA (t - r)]dr 

^ \^{t) + ^"(r) + </(r)]P ni0 (* - r)dr- (1) 
o 

dP n ,l(t) 

dt 



t 

J {/(r)P n , (t - r) - y? 7 (r)P„„i(t - r)} dr. (2) 



o 

Here we used waiting-time rate distributions ^(t), <p^(t) and <^ 7 (t), and it can be shown 
that they are related to waiting-time distribution functions via Laplace transforms,— 1 ^ 

l-^(s) 

with xp(s) = ip + (s) + $~(s) + ^P(s). 

After performing Laplace transformations the generalized master equations are modified 
into 

[s + fi + {s) +lp-(s) +$ P (s)] P nfi {s) = 5 nfi + fi + {s)P n ^ {s) + fi-{s)P n+lt0 {s)+^{s)P n ,l{sy, 

(4) 

[S + <F(8)] P n ,l(s) = ^(s)P nfi (s). (5) 

It is convenient to introduce new auxiliary variables: a = s + y? + (s) + !p~(s) + ~^tt^ ; 
b = tp + (s), c = <£>~(s) and d = ■ Combining Eqs.fll]) and (jSJ) and utilizing these 

variables leads to a simpler expression, 

aP n ,o(s) = S nfi + 6P n _i )0 (s) + cP n+1)0 (s). (6) 

This recursion relation can be solved exactly,— and the solution is given by: 

S f b \" 2 ^ - Vo 2 - 46c\ M 1 
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or more explicitly, 

(/ \ l n 
a+ y + ( fl)+ y-( a ) + -^-0 a+ y + ( 8 ) + y-( 8)+ -^ T ]2_ 4 ^ +(a) ^- (8 ) 
2y/lp+(s)!p-(s) ' X 

1 



(8) 



y/ [s+!p+(s)+!p- ( a )+^W T ]2-4^+ ( a )£- («) 

It can also be written in terms of the original waiting-time distribution functions with the 
help of Eqs. ©, 

|n| 



> ( S )J \l-^(s)^(s) + y / (l-^(s)^( s ))2_4^+( s )^-( s ) 



^(1 - ^(s)^(s)) 2 - 4^+{s)ip-(s) 



(9) 



Similar formulas for P n ,i(s) are easily obtained directly from Eq. (JS]). These results are 
exactly the same as have been obtained in Ref. 20 by a different method. 

Exact analytical expressions for Laplace transforms of probability distribution functions 
[Eqs. (jHJ)] provide a convenient method of analyzing dynamics of CTRW model on the lattice 
with branched states at all times. To illustrate this, let us calculate first two moments of 
the motion for the system. We define (n(t)) as the average position of the random walker 
at time t, and the corresponding Laplace transform is given by 

oo oo 

(n(s)} = <Pn,o( s ) + Pn,i(s)) = (1 + d) riP n>0 {s), (10) 

n=— oo n=— oo 

which yields^ 

{n{3)) = (1 + d \a-b-cf = 1 + ^L [ P 1" (U) 

Similar analysis of the Laplace transform for the second moment produces, 

oo oo 

(a)> = ]T n 2 (P n , (s) + i 5 „, 1 ( S )) = + ]T n 2 P n , ( S ) 

7i=— oo n=— oo 

(b + c)(a + b + c) - 86c 



+ (a-6-c)3 
[gjj + ?"(*)][* + 2^ + (^) + 2g-(j + gg|] - 8g+(jg-(j 



(12) 
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The steady-state dynamic behavior of the first and second moments (t — > oo) can be 
found by considering the limit of s — > 0. Expanding Laplace transforms of waiting-time rate 
distributions for small s, one could write^ 5 - 



<f (s) ~ u + g s + ■■•, v 9 ( s ) — w + 9 « + •■■, 
<jP(s) ~/3 + /s + --- , ^(s) ~ 7 + p T s + ... , (13) 

where w = ^ + (s = 0), w = (p~(s = 0), (3 = (p@(s = 0) and 7 = £> 7 (s = 0) are effective 
transition rates; 15 while = ^—\ s=0 , g@ = ^-\ s=0 and g 1 = ^| s=0 . To proceed further, 
we substitute these expansions into Eqs. ( FlTT) and ( fl2l) . leading to 

(u-uri , (<? + -<T) , (u-w) /l + £ 7 <A /3 



("(*)> - ^ + ^TT^ + 1 — - - ^ ) ^ (14) 



l + f l + f (1 + !) 2 V 7 /?/7' 

4(u - w)(# + - #") { (u + ty) + 4(u-w) 2 / 1 + # 7 fi^ /9 



l + f) 2 (l + f) (l + f) 3 V 7 /V 7 



t. 



(15) 

The large-time behavior of the moments allows us to compute important dynamic proper- 
ties such as the effective drift velocity V and the effective diffusion constant D. The velocity 
is found from 

V = lim = ( 16) 

7 

The corresponding expression for the diffusion constant is given by 

D= l l . m d(n 2 (t))-(n(t)} 2 _(u + w) , (u-w)(g+-g-) , ( M - W ) 2 /l + s 7 <A £ 



2*^00 dt (i+f) (i + f)2 (1 + f) 3 v 7 /?; 7' 

(17) 

It is important to note that these equations reproduce expressions for stationary-state dy- 
namic properties of the CTRW model with branched states, as was obtained earlier by 
different methods.— 



III. CTRW ON COUPLED PARALLEL-CHAIN LATTICES 

In this section, a CTRW model on more complex network that consists of coupled parallel 
chains (see Fig. lb) is investigated. The random walker can be found in one of two lattices. 
On the lattice 1, the waiting time distributions to move forward or backward along the same 
chain are given by probabilities tpi(t)dt and ip±(t)dt, respectively. Similarly, ip^(t)dt are 
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the probabilities to hop along the lattice 2: see Fig. lb. The particle from the lattice 1 can 
jump to the same site on another channel with the probability il> J (t)dt, while the reversed 
motion has the probability ib 6 {t)dt. Since only the homogeneous CTRW model is analyzed 
here these probabilities do not depend on the site position. Again, we introduce a function 
P n ,i(t) as the probability to find the particle on the site n on the channel i (i — 1, 2) at time 
t. For initial conditions we assume that the particle at t — starts in the first channel at the 
site n — 0. Then the temporal evolution of the system is governed by a set of generalized 
master equations: 



dP n ,i{t) 



dt 



J [<pt(T)P n - ltl (t - r) + v?r (r)Pn+i,i(t - t) + <p s (T)P n>2 (t - r)]dr, 

[<pt(r) + <pT(t) + ^(r)]P n>1 (t - r)dr (18) 



o 

t 







dP n , 2 (t) 



dt J [^(r)P n _i )2 (* - r) + ^(T)P n+1:2 (t - r) + ^(r)P nA (t - r)]dr 
o 

t 

~ J [<pt(r) + ¥>j(r) + /(r)]P n , 2 (t - r)dr. (19) 
o 

In these equations rate-distribution functions are related to waiting-time distributions as 
follows: 

( s ) = — ; v^ 7 (s) = 



l-^i(s) l-^i(s) 

, (s) „ X/ . sib (s) , \ 

^ (a ) = -^UJ-; S(s) = -XU-: (20) 

1-^ 2 (S) 1-^2(S) 

with ^i(s) = V'i + ( s ) (s) + -^ 7 (s) and ^(-s) = ^2 + (s) + "^2 (s)+^(s). 

Applying the Laplace transformation to generalized master equations, we obtain, 

[S + ^i + {s) + £T( S ) + ^(s)] P n ,l{s) = <5 n , +^ + (s)P„_l,l(s)+^(s)Pn+l,l(s)+^ <5 (s)P„,2(s). 

(21) 

[s + ^ + (s) + £T(s) + £*(s)] P n , 2 (s) = ^ + (s)P n _i, 2 (s) + ^"(s)P n+ i, 2 (s) + ^ 7 (s)P„,i(s). 

(22) 



The conservation of probability in this system, Yun=-oo [Pn,i(t) + P n ,2(t)] = 1, leads to the 
following expression in the Laplace space, 

oo 

E \Pn,i(a) + P n , 2 (s)\ =- (23) 



For convenience, we define new parameters: d\ = y 7 (s), d 2 = v 9 * 5 ! 5 ); &i = (s) , c\ = 
^2 = ^2 + ( s ) an d c 2 = cp2~(s). Then summing over Eqs. (1211) and fl22l produces 

oo , oo 

E *U«) = 7^ E (24) 



oo , oo 



E p ^ = 8 -^r £ Pn ' 2(s)) ' (25) 

n=— oo ^ n=— oo 

which suggests that the following relation holds: 

d\ s + d\ 
s + d 2 d 2 

Then using the normalization condition, Eqs. ( I24p and fl25|) one can show that 



(26) 



oo , 

E^w-^^y (27) 

n=— oo v 

oo , 

E *U«) = 7 (28) 
Next we make an assumption that 

P n , 2 (s) = KP n>1 (s) (29) 

and from Eqs. ( 1271) and ( 1281) the unknown parameter can be easily determined, 

K = ^-= S -±^. (30) 
s + d 2 d 2 



In terms of waiting-time distributions this expression can be rewritten as 



(31) 



(s)-^l («) 1-^2 (S)-V>2 («) 

This is an important result since it sets a constraint on possible waiting-time distribution 
functions that describe homogeneous CTRW on the coupled parallel lattices. 
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Combining Eqs. ([ZED and ([22]) with flU}, we obtain: 

AP n ,i(s) = 5 n , + BP n -i,i(s) + CP n+lil (s), (32) 

where new auxiliary functions are defined as 

A _ , , , , cii(s + fe 2 + c 2 ) 

A = S + 0i + Ci + - 



S + C? 2 

dib 2 



B = s + bi + 



s + d 



2 



C = s + c 1 + ^-, (33) 
s + d 2 

The recursion relation (I3"2"|) is similar to Eq. (jH]), and the solution again can be found in the 
following form,— 

~ . , (B\ n/2 fA-VA*-4BC\ lnl 1 



Similar expression for P n ,2{s) can be easily obtained from Eqs. (1291) and ( )30l) . 

The Eq. ( )34|) provides a full description of the CTRW dynamics on the coupled parallel 
channels at all times. It will be illustrated by looking at first two moments of motion. It 
can be shown that the Laplace transform of the first moment is equal to 

OO j oo 

(n( S )> = n{ ?^{s) + P^OO) = (1 + — l —) np nAs), (35) 

S + CL 2 

n=—oo n=— oo 

which can also be written as 

/-/ ^ _ (h - ci)(s + d 2 ) + (b 2 - c 2 )(s + dx) 

\ n \ s )l — o/ . j . j \ • l^CJ 

s 2 (s + di + d 2 ) 

Utilizing waiting-time distributions it can be shown that, 

,~ ( u _ (^ + (^) - gng)) (g + g(j) + c^ + (*) - gng)) (f + ^00) 

Similar calculations for the Laplace transform of the second moment produce 

f~ 2 f \\ _ [s+^^)] 2 {s[ipi+(s)+ifi-(s)]+2[^+(s)-^[-(s)] 2 ) 
\ n V s )) — 5 3 (s+^T(a)+^»(s)) a 



+ 



y' 5 (5)^( ;i )(s[yI+( S )+^-(8)+^+( g )+^-(6)]+4[^+( S )-^-( S )][^+(^)-yI-(g)]) 



S 3 (s + ^T(s) + </(s)) 

[s+yW(s[^ + (s)+^-(s)]+2[^+(s)-y5-(s)]2) , . 

H S 3 (s+£t(s)+£*(s)) 2 • 
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The stationary-state behavior (t — > oo) of the first and second moments of the motion can 
be found by using expansions of waiting-time rate distribution functions at s — > 0, 

pl + (s) ~ ui + gfs H , v^T(s) ~ w 2 + Q2 s H , 

vT{s) ~wi + g±s^ ,^2 + (s) ~u 2 + ^sH , 

cp s (s)~5 + g s s + ---, ^ 7 (s) ~7 + ^ 7 s + --- , (39) 

where Ui = (f>i + (s = 0), Wi = (fi~(s = 0) for i = 1,2; 8 — {p 5 (s = 0) and 7 = y? 7 (.s = 0) 
are effective transition rates. 15 Other coefficients are given by gf = ^P— | s= o for i — 1,2, 
g s = ^-\ s=0 and g 1 = ^p| s=0 . The asymptotic calculations then produce the following 
results for the average position of the random walker, 

(n(t)} ~ [ («i-^i)^2-^ 2 )7 ] t 
+ ^ " + ^) + 5 (9f - 9i) + {U2 - w 2 )(l + <? 7 ) + 7 (<?+ - g 2 

_ (i+g s +g J )[S(u 1 -w 1 )+-y(u 2 -w 2 )] 
(7+5)2 

The expression for mean-squared position of the particle is more complex, 



(n 2 (t)) ~ |' ("i-"'i)^+("2-«'2)7 j2^2 

[(tti+wi)i5+(n2+W2)7] 2(l+g s +g~t)[8(ui-wi)+j(u 2 ~w 2 )] 2 

(S+7 (7+<5) 3 

45 2 (u 1 -w 1 )(g+ -g-)+4y 2 (u 2 -w 2 )(g+ -9 2 )+4h(v>i-™i)(9t -9 2 )+ i h{u 2 -w 2 ){g+ -g-)\ 

(5+7? 



+ 



and the effective diffusion constant, 



D 



[(ui+wi)8+(u 2 +w 2 )-y] 



2(5+7) 

^8 2 (u 1 -w 1 )(g+-g~)+^/ 2 (u 2 -w 2 )(g+-g~)+8^(u 1 -w 1 )(g+ -g 2 )+8-y(u 2 -w 2 )(g+-g-)] 

(5+7? 

1 7^("l -w 1 ) 2 (l+g s )+8f(u 2 -w 2 ) 2 -S 2 g~t (m -w^ 2 ~-y 2 g s (u 2 -w 2 ) 2 
~T (5+7)3 

_ (tn-wi)(^ 2 -W2)[57(2+gT+g' 5 )+7 2 g f +<5 2 g 7 ] 
(5+7) 3 



(40) 



[A8(u 1 -w 1 ) 2 (l+g s )+A^{u 2 -w 2 ) 2 {l+g^)+A{u 2 -w 2 )(u 1 -w 1 )(^g 5 +8g^)] 1 , . 

These expressions allow us to derive the stationary drift velocity, 



(43) 



When the waiting-time distribution functions are exponential all transitions in the system 
become Poissonian and CTRW models are reduced to simple random walk processes. In this 
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case we have gf — g x = g 2 = g 2 — 9 1 — 9 S — 0, and the expression for dispersion is much 
simpler: 

[{U 1 +W 1 )5+(U 2 + W 2 )i\ [(Ml - Wi) 2 - (U2 - W 2 ) 2 } 

2(5 + 7) (^ + 7) 3 ' 1 ) 

It agrees exactly with the formula obtained earlier for stationary properties of ordinary 

random walks on coupled parallel-chain lattices.— 

To test the validity of our approach, one could notice that the CTRW model with the 

branched states can be viewed as a special case of the CTRW on coupled parallel channels 

if the motion along one of the lattice is disabled, i.e., ip 1 (t) = or t/> 2 (t) = 0. Then one can 

show that in this case the Laplace transform for the probability function to find the particle 

at the site n, Eq. fj34"j) . reduces to the main result of Section 2, Eq. (jSJ), as expected. 



IV. GENERALIZED FLUCTUATION THEOREM 



Fluctuation theorems are important for understanding fundamental mechanisms of com- 
plex phenomena.— - — Generalized fluctuation theorems, which reduce to the original formula- 
tion under some condition, have been introduced and studied for several CTRW models.—^ 



The analysis is performed by considering the ratio of 



Pn(s) 
P-n{s) 



. Theoretical results obtained in 



this paper allows us to investigate explicitly generalized fluctuation theorems for CTRW on 
complex networks. 

For CTRW model with branches it can be shown that 

(45) 

It is the same formula as for the homogeneous CTRW on lattices without branched states,— 1 ^ 
suggesting that reversible detachments do not affect the ratio of probabilities for forward 
and backward steps of the random walker. Consequently, branched states do not change 
statistics for occurrence of different fluctuations. It leads to the original fluctuation theorem 



Pud**) 


_ PnAs) 


1p + 


00" 


n 


p+ooi 


P-nfi( s ) 


P-n,l(s) 




00 







result when 



4> + (t) 



is time- independent. 



For the CTRW model on coupled parallel channels the results are more complex, 



Pn,l(s) PnM 



P-nAs) P-nAs) 



&-(s)(s + & s (s)) + £T(s)^r(s). 

^ + ( g )( g + ^( g ))+^ + ( g )^( g ) - 

£T00(s + <jn{s)) + ^-(s)^(s). 



(46) 
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In terms of the waiting-time distribution functions the generalized fluctuations theorem has 
the following form, 



PnAs) 



PnM 



P-nM P- n M 



ijh (g)(l-^2 {s)-^{s))+^2 (S)^(S) 

J 2 + {s){l - Ji + {s) - jh{s)) + g^(g)g(g)" 
^»(1 - ^h + (s) - Jx{s)) + ^~(s)&(s)_ 



(47) 



This result can be understood physically using the following arguments. The numerator 
can be viewed as an effective waiting-time distribution function to move forward, which 
is averaged over finding the particle on the lattice 1 and 2. The denominator has the 
meaning for effective waiting-time distribution function to move backward. It also shows 
the importance of transitions between channels on individual trajectories and on statistics 
of fluctuations. 



V. SUMMARY AND CONCLUSIONS 

A theoretical method of calculating all-time dynamics of continuous-time random walks 
is extended to processes that take place on complex networks. Specifically dynamic prop- 
erties of CTRW models on the lattices with branched states and CTRW models on the 
coupled parallel channels are analyzed at all times. The theoretical approach is flexible and 
robust to deal with complex CTRW models since it is based on the construction of the 
generalized master equations which are solved exactly in the Laplace space. It suggests that 
homogeneous CTRW processes on any networks can be analyzed in the similar way. 

Our calculations yielded stationary-state dynamic properties for processes that can reach 
the steady states. All derived results for drift velocities and dispersions of CTRW models 
on complex networks at stationary conditions agree with available large-time expressions 
obtained by different methods. In addition, generalized fluctuation theorems are discusses. 
It is shown that the presence of branched states do not affect fluctuation dynamics of par- 
ticles, while in the model with coupled parallel lattices transitions between channels are 
important. It will be interesting to extend this method to more complex inhomogeneous 
CTRW models on networks^ that will help to understand better fundamental mechanisms 
of various complex dynamic phenomena. 
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Figure Captions: 



Fig. 1. General schemes for continuous-time random walk (CTRW) models on complex 
networks, a) A lattice model with branched states. Here ip^(t), ip~(t), i[>f(t) and ip]{t) are 
waiting-time distribution functions to step forward, backward, to the branched state and out 
of the branched state, correspondingly, b) A parallel-chain lattice model. Here an d 
ipj^iif) are waiting-time distribution functions to move forward or backward on the lattice 
j — 1 or j — 2. Also, ipfif) and ipjit) are waiting-time distribution functions to transition 
between lattices. 




Figure 1. Teimouri and Kolomeisky 



